R-Theory for Markov Chains on a Topological State Space. II
نویسندگان
چکیده
~z"P"(x, A) of the n-step transition probabilities, we follow Tweedie [6] in using 1 the following form of irreducibility: there is a probcbility measure M on g for which M(A)>0 implies that G~(x,A)>O for all x~g, and M(A)=0 implies M{y: G~(y,A)>O}=O. We denote {A~,~: M(A)>0} by Y+; "almost all x" shall henceforth be with respect to this M. Tweedie [6] has proved the following solidarity results for such a chain (cs Theorems A and C of [4]):
منابع مشابه
The Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملGeneralized Resolvents and Harris Recurrence of Markov Processes
In this paper we consider a φ-irreducible continuous parameter Markov process Φ whose state space is a general topological space. The recurrence and Harris recurrence structure of Φ is developed in terms of generalized forms of resolvent chains, where we allow statemodulated resolvents and embedded chains with arbitrary sampling distributions. We show that the recurrence behavior of such genera...
متن کاملOn the Poisson Equation for Markov Chains : Existence of Solutions and Parameter Dependenceby Probabilistic
This paper considers the Poisson equation associated with time-homogeneous Markov chains on a countable state space. The discussion emphasizes probabilistic arguments and focuses on three separate issues, namely (i) the existence and uniqueness of solutions to the Poisson equation, (ii) growth estimates and bounds on these solutions and (iii) their parametric dependence. Answers to these questi...
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملThe Poisson Equation for Countable Markov Chains: Probabilistic Methods and Interpretations
This paper considers the Poisson equation associated with timehomogeneous Markov chains on a countable state space. The discussion emphasizes probabilistic arguments and focuses on three separate issues, namely (i) the existence and uniqueness of solutions to the Poisson equation, (ii) growth estimates and bounds on these solutions and (iii) their parametric dependence. Answers to these questio...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004